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I.  Introduction 


In  his  paper  [7]  Massey  noted  that  there  was  neither  mathematical  nor 
experimental  justification  for  the  hypothesis  of  statistical  equilibrium 
assumed  by  Abramson  and  others  in  their  calculation  of  the  maximum  throughput 
of  the  slotted  ALOHA  mul ti access  algorithm.  Now  the  opposite  of  statistical 
equilibrium  is  instability  which  in  the  present  context  means  the  number 
of  blocked  terminals  becomes  infinite  with  probability  one  as  time  tends  to 
infinity.  Using  simulations  Kleinrock  and  Lam  [5]  noted  that  the  uncontrolled 
slotted  ALOHA  scheme  is  unstable.  A  mathematical  proof  of  this  fact  was 
offered  by  Fayolle  et  al .  [2]  using  a  Markov  chain  model  to  describe  the 
number  of  blocked  terminals.  Translated  into  the  language  of  Markov  chains 
instability  as  defined  above  is  equivalent  to  showing  that  the  Markov  chain 
is  transient,  see  e.g.  Karlin  and  Taylor  [4]  for  the  necessary  definitions  and 
background.  In  particular  we  remind  the  reader  of  the  well  known  fact  that  an 
irreducible  aperiodic  Markov  chain  falls  into  one  of  three  mutually  exclusive 
(and  exhaustive)  classes:  positive  recurrent,  null  recurrent  and  transient, 
see  e.g.  Karlin  and  Taylor  op.  cit. 

Now  Fayolle  et  al  [2]  showed  that  the  Markov  chain  occurring  in  their 
model  of  the  slotted  ALOHA  scheme  is  not  positive  recurrent  from  which  they 
erroneously  include  that  the  Markov  chain  is  transient.  Unfortunately  they 
did  not  exclude  the  possibility  that  it  might  be  null  recurrent.  Nevertheless 
their  assertion  that  the  Markov  chain  is  transient  is  correct  and  we  present 
in  this  paper  a  novel  proof  of  this  fact  based  upon  a  martingale  method  of 
Independent  interest.  The  elementary  facts  c*.  icerning  martingales  and 
Markov  chains  that  we  shall  need  are  summarized  in  part  II  and  the  application 
to  the  Markov  chain  model  of  Fayolle  efcfidlkQ 
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II .  Transient  Markov  Chains  -  A  Martingale  Approach 

In  this  section  we  present  a  well  known  method  (at  least  to  Probabilists)  . 
for  constructing  a  supermartingale  associated  to  a  Markov  chain  which  leads  to 
a  simple  sufficient  condition  for  a  Markov  chain  to  be  transient. 

Let  {Xk,  k  =  0,1,2,...}  denote  a  Markov  chain  with  state  space  the  non 
negative  integers  I+  =  {0,1,2,...}  and  transition  matrix  P^j  =  P(Xk+-|  =  jlXk=1^' 
In  addition  we  assume  that  the  Markov  chain  is  irreducible  and  aperiodic.  Now 
if  {Xk}  is  recurrent  (whether  it  is  positive  or  null  recurrent  is  immaterial) 
then  the  even  {Xk  =  j}  occurs  infinitely  often  (abbreviated  i.o.)  with  pro¬ 
bability  one  for  any  state  j.  Suppose  we  can  construct  a  non  negative, 
non  constant  function  f:I+  R+  =  [  0,~)  satisfying  the  following  sequence  of 
inequal ities: 

oo 

(1)  l  P.^f(j)  <_  f(i)  for  every  i  e  I+. 
j=o  J 

00 

Now  E(f(Xk+i ) | Xk  =  i)  -  ]  P^ jf ( j )  1  f(i)  =  f(Xk)  and  by  the  Markov  property 

(2)  E(f(Xk+1) |XQ, . ,  Xk)  =  E(f(Xk+1)|Xk)  <  f(XR).  Consequently  the  sequence 
of  random  variable  f(Xk)  is  a  non  negative  supermartingale  with  respect 
to  { Xk} ,  see  e.g.  Karlin  and  Taylor  [4],  Definition  1.2,  p.  239  or  the 
more  general  definition  to  be  found  in  Doob  [1].  We  shall  call  fa 
supermartingale  generating  function. 

(3)  .Theorem  (Doob):  A  non  negative  supermartingale  converges  with  probability 
one. 

This  is  a  basic  result  in  martingale  theory  and  we  refer  the  reader  to 
Doob  [1]  for  the  proof. 

(4)  Theorem.  Suppose  the  irreducible  aperiodic  Markov  chain  {X^>  admits  a 

non  constant,  non  negative  supermartingale  generating 

function  f.  Then  the  Markov  chain  is  transient  i.e.,  P(  1  im  Xs®)  ■  1. 

k  -*■  ® 
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Proof:  Assume  to  the  contrary  that  { Xk }  is  recurrent  and  let  be  any  two 

states  for  which  f(ju)/f(jj)  (since  f  is  non  constant  such  a  pair  exists  , 

by  hypothesis).  Now  recurrence  implies  that  X^=  jQ  and  i.o. 

with  probability  one  and  hence  f(XR)  =  f(jQ)  and  f(Xk)  =  i.o.  with 

probability  one.  But  this  implies  that  lim  f(X. )  does  not  exist 

k-* »  K 

because  f(jQ)^  f(j-|)  and  this  contradicts  Doob's  martingale  convergence 
theorem  (3). 

HI*  Instability  of  the  slotted  ALOHA  scheme  via  a  martingale  generating  function. 
We  now  apply  the  results  of  part  2  to  the  study  of  the  slotted 
ALOHA  scheme  as  presented  in  Fayolle  et  al  [2].  First,  some  notation: 

4  numbei"  of  packets  awaiting  to  be  transmitted  at  time  k 
and  A^  a  the  number  of  new  packets  that  arrive  during  the  k^1  time 
interval.  We  make  the  following  standard  assumptions: 

(5)  ^o’^l’* *  *\*  are  n^ndom  variables  with  probability  distribution 

p(Ak  =  j)  *  Aj,  i  =  0,1,2...  and  moment  generating  function 

=  l  A-41. 
j=o  J 

(6)  The  A^'s  are  independent  of  the  X^'s  and  when  a  new  packet  arrives 
during  the  k^  interval  it  is  transmitted  in  the  next  time  interval; 
thus,  two  or  more  arrivals  at  time  k  lead  to  a  collision  at  time  k  +  1. 

(7)  If  a  terminal  is  blocked  at  time  k  it  retransmits  with  probability 
p,  o<p<l,  at  time  k  +  1  and  each  terminal  acts  independently  of  the 
others. 

Under  these  assumptions  it  is  easy  to  see  that  the  process 
<*k>  is  a  Markov  chain  with  transition  Matrix  P.  .  given  by 

Poj  =  •  Ji° 

pii-i  ■  ypo-p)1"' 
pij  ■  «• 

pij  *  Vi  o-p)1  +  Xj.,  o-d-p)' .  tp(i-p)1-') 


To  insure  the  Markov  chain  is  aperiodic  and  irreducible  it  suffices  to  assume 

(9)  0<X0<10 

Construction  of  the  supermartingale  generating  function  f: 

We  try  a  solution  of  the  form 

(10)  f(j)  =  for  some  o<£<1.  There  are  two  cases  to  consider: 

Case  1:  a  =  sup^ip(l-p)1"1  <  ^'(1) 

Case  2:  Since  lim  ip(l-p)1-^=0  there  exists  i*  such  that  ip(l-p)^ 

i->oo 

<  '  (1 )  for  i>i*. 

(11)  Theorem:  (a)  If  ty'd)  >  a  then  there  exists  a  o<£<1  such  that 

f(j)=SJ  is  a  supermartingale  generating  function;  (b)  If  y'(l)<a 

then  there  exists  an  integer  i  such  that  f(j)=l,  o<j<_i*  and  f(j) 
i  -  i* 

£  .  j>i*  is  a  supermartingale  generating  function. 

00  c» 

rJ  - 


Case  1:  Note  that  £  P  .f(i)  =  \  X  =  \p(£  )il=f(0)  so  inequality 
j=o  0J  j=o  J 

is  certainly  satisfied  when  i=o.  Turning  now  to  the  case  i>o  we 

have  J  P  e  =  I  pii X  ip(i-p)1'1Ci‘1  +  I  Ul-ipd-p)1*1)^*1 
jao  j=i-l  1J  0  k=o  K 

+  I  \+1  ip(l -p)1_1Ck+1  = 


k=o 


c1‘1{xoiFa-p)1-1  + 1  xk(i-ip(i-p)i*l)ck+1  +  j  xk+1  ipd-p)1-1^1}. 


k=o 


k=o 


Note  that  l  Xdl-ipd-p)1'1)^*1  =  Cd-ipd-p)1"1)  l  Xk£K  * 

k=n  *  K 


1-1* 


k=o 


k=o 


=  C(l-ip(l-p)i~1)^(C)  and  that  l  Xk+J  ipd-p)w£ 


i-1  Jc+1. 


ip(-p)^  *  [  X.£K  =  ip( l“p)1-A( ^..(  ^)-X  ) .  Upon  suitably  rearranging 
k=l  0 

terms  we  obtain  the  formula 

(12)  j  PiiCJ  •  51'1  v  (OiCd-ipd-p)1'1)  +  ipd-p)1'1) 


,i-l< 


k=o 


J=o 


TJ 
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consequently  f(j)=iJ  will  be  a  supermartingale  generating  function 
provided 


(13) 

(14) 


(14*) 


{"~1'KOU(l-ip(l-p)i~1)+ip(l-p)'”1)lCi »  equivalently 


^(C)£C/{^(l-ip(l-p)il)  +  ip(l-p)  "*},  i=l,2...  Denote  the  function 
occurring  on  the  right  hand  side  of  (14)  by  0^(fJ  and  set  ip(l-p)’** 
=  a.  noting  that  lim  ip(l-p)i-*=0.  Observe  that  0^  is  concave 

i-x» 

on  [0,1],  0^  ,(l)=a^<sup^ai  =  a  ^  ‘(1)  and  that  a>a^  implies  0^U) 
</,/{£;(  l-a)+a}  on  [0,1].  Consequently  h(£)  =  'HO-U/U(l-a)+a)] 
is  convex  on [0,1]  with  h(0)  =  Ag>0,  h(l)  =  0  and  h'(l)  =  0  and 
h'(l)  =  ^'(1)  -  a  >  o.  Therefore  there  exists  a  £*,0<£*<1  such 
that  h(0<o  on  the  open  interval  (£*1)  and  this  implies  that 
^U)  -  01(O<  h(£)<0  for  all  C  in  U*,l)  and  all  i,  so  »p( C)<0i ( C) 
for  at  least  one^in  (£*,1).  This  completes  the  construction  of 
the  supermartingale  generating  function  f  in  case  1. 

Case  2:  Since  lim  0.' (1)  =  lim  a.  =  0  it  follows  there  exists 

l-oo  1  l-*o  1 

an  ix  such  that  a.<^'(l)all  i>i*.  If  we  now  set  f(j)=l  for 
o<j<i*  and  f(j)  =  for  j>  1*  and 


o<£<1  then  the  inequalities  £  P- l=f(i),  o<^i <_i *  are  auto- 

j=o  ,J 


matically  satisfied  whilst  for  i>i*  the  same  calculation  as  in 
case  1  leads  to  the  condition 

^(S)<C/!C(l-ip(l-p)i"P)+ip(l-p)i"1],  i>i*  for  some  £  in  (0,1). 


By  choosing  i*  so  that  sup  0‘(1)  =  sup  a.  <  \p  '(1)  the  same  rea-  „ 

i>i*  i>i*  1 

soning  using  in  case  1  may  be  applied~here  to  conclude  that 


Pof* 


condition  (14')  is  satisfied.  The  proof  is  finished. 


r 


—  v .  i  .it ;  cn/ 

1  Avails t  i  l.it.y 
1  Avail  n ! *  . . jp 

|  SDficv  I 


□  "I 
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IV.  Concluding  Remarks 

It  is  interesting  to  note  that  martingale  methods  may  also  be  used  4 
to  prove  stability.  In  the  context  of  Markov  Chains  this  was  already 
done  by  Lamperti  [6]  and  for  applications  to  the  control  of  queueing 
processes  see  the  forth  coming  paper  by  Hajek  [3]. 


m 


-7- 


References 


[1]  J.  L.  Doob,  Stochastic  Processes,  Wiley,  New  York,  1953. 

[2]  G.  Fayolle,  E.  Gelenbe  and  J.  labetoulle,  "Stability  and  Optimal  Control 
of  the  Packet  Switching  Broadcast  Channel",  J.  of  the  Asso.  for  Comp. 
Machinery,  Vol .  24,  No.  3,  July  1977,  pp.  375-386. 

[3]  B.  Hajek,  "Hitting  Time  and  Occupation  Time  Bounds  Implied  by  Drift 
Analysis  with  Application",  Advances  in  Applied  Probability  (to  appear). 

[4]  S.  Karlin  and  H.  Taylor,  A.  First  Course  in  Stochastic  Process,  2nd 
Edition,  Academic  Press,  New  York,  1975. 

[5]  L.  Kleinrock  and  S.  Lam,  "Packet  Switching  in  a  Multi  Access  Broadcast 
Channel:  Performances  Evaluation".  IEEE  Trans,  on  Communication  Com -23, 
4  (April  1975),  pp.  410-423. 

[6]  J.  Lamperti ,  "Criteria  for  the  Recurrence  or  Transience  of  Stochastic 
Processes  I",  Journ.  of  Math.  Analysis  and  Applications  1,  pp.  314-330 
(1960). 

[7]  J.  L.  Massey,  "Collision  Resolution  Algorithms  and  Random  Access  Com- 
Munications"  in  Multi-User  Communications,  G.  Longo,  Ed.  New  York: 

Springer  -  Verlag. 


